Evolution Management in a Complex Adaptive System: Engineering the Future 
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We examine the feasibility of predicting and subsequently managing the future evolution of a 
Complex Adaptive System. Our archetypal system mimics a competitive population of mechanical, 
biological, informational or human objects. We show that short-term prediction yields corridors 
along which the system will, with very high probability, evolve. We then show how small amounts 
of 'population engineering' can be undertaken in order to steer the system away from any undesired 
regimes which have been predicted. Despite the system's many degrees of freedom and inherent 
stochasticity, this dynamical 'soft' control over future risk requires only minimal knowledge about 
the population's composition. 
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Complex Adaptive Systems (CAS) are of great inter- 
est to theoretical physicists because they comprise large 
numbers of interacting components or 'agents' which, un- 
like particles in traditional physics, may change their be- 
havior based on past experience 0. Such adaptation 
yields complicated feedback processes at the microscopic 
level, which in turn generate complicated global dynam- 
ics at the macroscopic level. CAS also arguably represent 
the 'hard' problem in biology, engineering, computation 
and sociology 1]. Depending on the application domain, 
the agents in CAS may represent species, people, bacte- 
ria, cells, computer hardware or software, and are typi- 
cally fairly numerous, e.g. 10^ — 10'^ 

There is also great practical interest in the problem 
of predicting and subsequently controlling a Complex 
Adaptive System. Consider the enormous task facing a 
Complex Adaptive System 'manager' in charge of over- 
seeing some complicated computational, biological, med- 
ical, sociological or even economic system. He would cer- 
tainly like to be able to predict its future evolution with 
sufficient accuracy that he could foresee the system head- 
ing towards any 'dangerous' areas. However, prediction 
is not enough. He also needs to be able to steer the sys- 
tem away from this dangerous regime. Furthermore, the 
CAS-manager needs to be able to achieve this without 
detailed knowledge of the present state of its thousand 
different components, nor does he want to have to shut 
down the system completely. Instead he is seeking some 
form of 'soft' control. Unfortunately, his task looks hope- 
less. Even in purely deterministic systems with only a few 
degrees of freedom, it is well known that highly complex 
dynamics such as chaos can arise (3^ making both predic- 
tion and control very difficult ~ for example, the 'butter- 
fly effect' wherein small perturbations have huge unpre- 
dictable consequences. Consequently, one would think 
that things would be considerably worse in a CAS, given 
the much larger number of interacting objects. As an ad- 
ditional complication, a CAS may also contain stochas- 
tic processes at the microscopic and/or macroscopic lev- 
els, thereby adding an inherently random element to the 



system's dynamical evolution. The Central Limit Theo- 
rem tells us that the combined effect of a large number 
of stochastic processes tends fairly rapidly to a Gaus- 
sian distribution. Hence, one would guess that even with 
reasonably complete knowledge of the present and past 
states of the system, the evolution would be essentially 
diffusive and hence difhcult to control without imposing 
substantial global constraints. 

In this paper, we examine this question of evolution 
management for a simplified, yet highly non-trivial model 
of a CAS. We show that a surprising level of prediction 
and subsequent control are indeed possible. First we 
show that with very little knowledge about the system's 
past behavior, one can produce corridors (Future-Casts) 
along which the system will subsequently move, charac- 
terized by their width (Characteristic Stochasticity) and 
their average direction (Characteristic Direction). Al- 
though these corridors evolve as the system evolves, at 
any particular point in time they provide an accurate 
prediction regarding the subsequent evolution of the sys- 
tem. We then show that if the Future-Cast predicts sig- 
nificant future risk, the system's subsequent evolution 
can be steered to a safer regime via 'population engi- 
neering', i.e. by introducing small perturbations to the 
population's heterogeneity. Despite the many degrees of 
freedom and inherent stochasticity both at the micro- 
scopic and macroscopic levels, this global control requires 
only minimal knowledge and intervention on the part of 
a CAS manager. For the somewhat simpler case of Cel- 
lular Automata, Israeli and Goldenfeld 4] have recently 
obtained the remarkable result that computationally ir- 
reducible physical processes can become computationally 
reducible at a coarse-grained level of description. Based 
on our findings, one could speculate that similar ideas 
hold for populations of decision-taking, adaptive agents. 
Wc finish the paper by discussing a number of possible 
practical applications of our findings. 

It is widely believed (see for example, Ref. Q) that 
Arthur's El Farol Bar Problem provides a representa- 
tive toy model for CAS's which comprise a population of 



2 



objects competing for some limited global resource (e.g. 
space in an overcrowded area). To make this model more 
complete in terms of real- world complex systems, the ef- 
fect of network interconnections has recently been incor- 
porated 0. As mentioned later, our present analysis 
also applies to such networked populations. The El Parol 
Bar Problem concerns the collective decision-making of a 
group of potential bar-goers (i.e. agents) who use limited 
global information to predict whether they should at- 
tend a potentially overcrowded bar on a given night each 
week. The Statistical Mechanics community has adopted 
a binary version of this problem, the so-called Minority 
Game (MG) 0| , as a new form of Ising model which is 
worthy of study in its own right because of its highly non- 
trivial dynamics. Here we consider a generalized version 
of such multi-agent binary games which (a) incorporates 
a finite time-horizon T over which agents remember their 
strategies' past successes, to reflect the fact that the more 
recent past should have more influence than the distant 
past, (b) allows for fluctuations in agent numbers, since 
agents might only participate if they possess a strategy 
with a sufficiently high success rate, and (c) allows for a 
general reward structure thereby disposing of the MG's 
restriction to automatically rewarding the minority 0. 
The formalism is applicable to any CAS which can be 
mapped onto a population of N objects which repeat- 
edly taking actions in some form of global 'game'. Por 
simplicity, we restrict ourselves here to simply invoking 
competition for a limited resource L. Our model there- 
fore incorporates the features typically associated with 
complex systems: strong feedback, adaptation, intercon- 
nectivity etc. At each timestep t, each agent makes a 
(binary) decision a^(t) in response to some global infor- 
mation /x(t). This global information is a bitstring of 
length m, and may for example represent the history of 
past global outcomes. The global outcome at a given 
timestep is based on the aggregate action of the agents 
and the value of the global resource level L. Each agent 
holds k strategies (comprising a response to every possi- 
ble history) employing the one which would have proved 
most successful over the last T timesteps. By assign- 
ing these randomly to each agent, we mimic the effect of 
large-scale heterogeneity in the population. The strategy 
allocation is fixed at the start of the game, and can be 
described by a tensor of rank k or 'Quenched Disorder 
Matrix' (QDM) 0. Adding network connections sim- 
ply has the effect of redistributing elements within the 
QDM. The agents' aggregate action at each timestep t 
is represented by D(t), and S{t) = S(t - 1) + D{t - 1) 
gives the current global output value [lOj. Stochasticity 
arises via coin-tosses at both the microscopic level (to 
resolve an agent's tied strategies) and the macroscopic 
level (to resolve any ties when deciding the global out- 
come). This stochasticity implies that for a given QDM, 
the system's output is not unique. In short, the future 
evolution of the system results from the time- dependent 



interplay of time- dependent deterministic and stochastic 
processes. We refer to the set of all possible future tra- 
jectories of the game's output at t > 1 timesteps in the 
future, as the Future-Cast distribution. 

The game's dynamics can be transferred into a time- 
horizon space Pj spanned by all possible combinations 
of the last m -\- Tglobal outcomes (or equivalently, the 
winning actions) p|. Por a binary game, Pt has dimen- 
sion 2™+-'". Por any given time- horizon state Pt in this 
space, there exists a unique score vector G{t) whose ele- 
ment Gait) is the score for strategy R at time t. Each 
time a particular time-horizon state is reached, the ac- 
tions of the agents holding strategies whose scores are not 
tied, or agents holding tied strategies which prescribe the 
same action, will necessarily be the same. In addition, 
the number of remaining agents (i.e. those holding tied 
strategies prescribing different actions, which need to be 
resolved via a coin-toss) will also be the same. Subse- 
quently, the probability distribution oi D{t) will be iden- 
tical each time this time-horizon state occurs. The prob- 
abilities associated with the global outcomes which rep- 
resent the transitions between these time-horizon states 
are also static. Hence it is possible to construct a Markov 
Chain description for the evolution of the probabilities 
P(Pt) for these time-horizon states: 

P{Tt) - T P{Tt-i) . (1) 

The transition matrix T_ is time-independent and sparse 
since there are only two possible global outcomes for each 
state. The number of non-zero elements in the matrix is 
thus < 2('"+^+i). These values can be generated directly 
from the QDM It is straightforward to obtain the 
stationary state solution of Eq. (1) in order to calcu- 
late the system's time-averaged macrosopic quantities. 
Generating the Future- Cast probability distributions in- 
volves mapping from the internal (time-horizon) state dy- 
namics of the system to its global output. This requires 
(i) the probability distribution of D(t) for a given time- 
horizon T, (ii) the corresponding global outcome for a 
given D{t), and (iii) an output generating algorithm ex- 
pressed in terms of D{t). We know that in the transition 
matrix, the probabilities represent the summation over 
a distribution which is binomial in the case where the 
agents are limited to two possible decisions. Using the 
output generating algorithm, we can construct an ad- 
jacency matrix T to the transition matrix T, with the 
same dimensions. The elements of T contain probabil- 
ity functions corresponding to the non-zero elements of 
the transition matrix, together with the discrete convo- 
lution operator. Por the incremental algorithm described 
above, we define and use a convolution operator ® such 
tlmt (/ ® g) \^ = E^-oo /(« - i) X 9{j) (see Ref. 
jl2l | for full mathematical details). Consider an arbitrary 
timestep in the game, and label \t as t — {) for conve- 
nience. The adjacency matrix can then be applied to 
a vector ^{S,t = 0), where the element of <;{S,Q) corre- 
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spending to the current time-horizon state comprises a 
probabiUty distribution function for the current output 
value. Since <j(5,t) = T*^(S', 0), the Future-Cast at i 
timesteps in the future, 11(5, t), is given by: 

1=1 

Due to the state dependence of the Markov Chain, this 
Future-Cast probabihty distribution 11 is non-Gaussian. 
Consider t = 1. Since we are not interested in transients, 
we reahy need a 'steady state' form IIi = (11(5', 1))^ 
representing a time-average over an infinitely long pe- 
riod. Fortunately, we have the steady state solutions 
of P(r) = Z P(r) which are the (static) probabili- 
ties of being in a given state at any time. By repre- 
senting these probabilities as the appropriate functions, 
we can construct an initial vector k, which is equivalent 
to ^(5,0) [13. Hence we can generate the Characteristic 
Future- Cast Hi, describing the characteristic behavior of 
the Future-Cast projected forward from a general time 
t, for a given QDM. The element Ki is simply the point 
(0,Pi(r)). Characteristic Future-Casts for any number 
of timesteps t > 1 into the future, can be generated by 
simply premultiplying k by T : i.e. use Eq. (2) with 
£ = T* K. Hence the Characteristic Future-Cast over t 
timesteps is simply the Future-Cast of length t from all 
the 2™+-^ possible initial states, with each contribution 
being given the appropriate weighting factor. Note that 
Ht is not equivalent to the convolution of Hi with itself 
t times, and hence is not necessarily Gaussian. In other 
words, the Central Limit Theorem does not provide a 
good estimate of the future behavior of the system. The 
system is only quasi-diffusive at best. 

Figure 1 shows a typical example of the evolution of the 
Future-Cast at t timesteps ahead of the present timestep 
(which we label t = 0). The Future-Cast acts to provide 
non-Gaussian 'corridors' along which the system subse- 
quently evolves. The reason for the non-diffusive behav- 
ior is that, unlike the standard binomial paths set up 
during a simple coin-toss experiment, not all paths are 
realized at every timestep. The stochasticity generated 
at a given timestep, and hence the possible future paths, 
are conditional on the system's past history. Now sup- 
pose that an external CAS manager decides it dangerous 
for the system to have a large positive S{t) for t > 0. Fig- 
ure 2 shows the corresponding QDM for t < 0, together 
with the QDM perturbation which the system manager 
decides to introduce at i = 0. Such 'population engi- 
neering' can be achieved by switching on/off, rewiring or 
reprogramming a group of agents in a situation where the 
agents are accessible objects, or by introducing some form 
of communication channel - or even a more evolutionary 
approach whereby a small subset of agents ('species') are 
removed from the population and a new subset added 
to replace them. This evolutionary mechanism need nei- 
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FIG. 1: Evolution of the unperturbed Future-Cast probabil- 
ity distribution (blue solid) during a typical run of a game 
with the Quenched Disorder Matrix (QDM) of Fig. 2. The 
region of large positive deviation S{t) is considered danger- 
ous territory. Red distributions show corresponding evolution 
following a minor QDM perturbation (i.e. population engi- 
neering of Fig. 2) introduced at t = 0. Examples of future 
trajectories also shown. Note that t — labels an arbitary 
timestep chosen after initial transients have disappeared. 



ther be completely deterministic (i.e. knowing exactly 
how the form of the QDM changes) nor completely ran- 
dom (i.e. a random perturbation to the QDM). In this 
sense, it seems quite close to some modern ideas of biolog- 
ical evolution, whereby there is some purpose mixed with 
some randomness. Figure 1 shows the impact that this 
relatively minor perturbation has on the Future-Cast. In 
particular, the system gets steered 'away from danger' 
(i.e. toward smaller S{t) values). Note that a substan- 
tial reduction in future risk has been achieved without 
needing to know the microscopic details of each agent's 
individual strategies, since each QDM corresponds to a 
macrostate in the physical sense: i.e. it is only the aggre- 
gate number of agents holding each strategy pair which 
matters, not what an individual agent is holding. 

Engineering an appropriate QDM perturbation in- 
volves understanding the interplay between the (i) the 
mean of the Future-Cast distribution, referred to as the 
Characteristic Direction which acts as a 'drift' in terms 
of the future output signal, and (ii) the spread in the 
Future-Cast distribution, referred to as the Character- 
istic Stochasticity which acts as 'noise' in terms of the 
future output signal. Figure 3 shows how these quanti- 
ties vary for different QDMs for the illustrative case of 
m — 1 with a small population. This indicates the ef- 
fects of adding such a population as a perturbation to 
an unbiased system. In order to reliably steer S{t) to- 
ward larger/smaller values, the Characteristic Direction 
must be much larger than the Characteristic Stochastic- 
ity. As shown, the perturbation must therefore be biased 
toward the upper- left/lower- right half of the QDM (but 
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FIG. 2: The unperturbed Quenched Disorder Matrix QDM 
(blue) and its perturbation (red) used to generate Fig. 1. 
The i-j coordinates represent strategy labels for the k = 2 
strategies per agent, R and R* . These binary strategies R 
and R* are ordered according to their decimal equivalent. 
Here m — 2. The value in each box represents the number 
of agents assigned that particular pair of strategies during 
the initial random allocation. An empty bin implies no agent 
holds that particular strategy pair. 



not both). This means that the perturbed population is 
less adaptive than the unperturbed one (i.e. more agents 
hold two identical strategies) and less heterogenous (i.e. 
more agents populate the same region of the QDM). This 
observation explains why the QDM perturbation of Fig. 
2 had the desired steering effect shown in Fig. 1. By con- 
trast for perturbations which are unbiased in terms of the 
upper-left/lower-right half of the QDM, the Characteris- 
tic Direction is zero and hence there is no net steering, 
while the Characteristic Stochasticity is now large. These 
effects can be understood in terms of Crowd-Anticrowd 
formation in the strategy space 0, 0| . 

Finally, we give some examples to justify why we 
think our Complex- Adaptive-Systems control problem is 
so generic. Next-generation aircraft wings may contain 
thousands of autonomous mini-flaps placed along the rear 
of a wing . Denoting the binary actions of each mini- 
flap as 'up' and 'down', and rewarding flaps for their ac- 
tions given the 'resource level' L (e.g. the plane's current 
tilt) , Fig. 3 shows that one can simply switch on a small 
number of additional miniflaps in order that the aircraft 
then moves autonomously in a given direction. This is 
achieved without requiring sophisticated control of indi- 
vidual miniflaps, or inter-miniflap communication 
In human health, there is a possible application in so- 
called dynamic diseases. For example. Epilepsy is a dy- 
namic disease involving sudden changes in the activity of 
millions of neurons. Our work raises hopes that one could 
develop a relatively non-intrusive 'brain deflbrillator' us- 
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FIG. 3: Characteristic Direction and Characteristic Stochas- 
ticity, for illustrative QDMs with m = 1 and k = 2. Results 
are shown for t = 1 timesteps into the future. 



ing brief electrical stimuli over a small part of the brain, 
rather than intrusive control over each and every one of 
the constituent agents (i.e. neurons). In the area of can- 
cer therapy, the tumor to be eradicated comprises a pop- 
ulation of cancerous and normal cells which compete for 
a limited resource (i.e. oxygen in blood supply, and space 
to grow). It is possible that by understanding how the 
overall tumor cell population behaves, one could do some 
population engineering of a small group of the malignant 
cells in order to steer the tumour toward benign status. 
Even in the immune system, where the body supposedly 
self-regulates itself as a result of the interaction of hun- 
dreds of different biological processes (agents) , and where 
the corresponding 'steering wheel' remains unknown, our 
work suggests that one might be able to engineer one part 
of the system so that it boosts or suppresses the over- 
all immunological activity level. In a financial setting, 
where intervention in a market costs money, one could 
imagine that an external regulator could use our anal- 
ysis to steer a particular market indicator or exchange 
rate into a desired range without having to invest huge 
amounts of money. Further details of these applications 
will be published elsewhere. In short, we believe that 
the present problem lies at the heart of complex systems 
science both in terms of fundamental non-linear dynam- 
ical behavior and the consequences for practical safety 
management. 
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